home *** CD-ROM | disk | FTP | other *** search
/ Celestin Apprentice 5 / Apprentice-Release5.iso / Utilities / Communications / NetPresenz 4.0.1 / CGI Examples / robots.txt < prev   
Encoding:
Text File  |  1996-01-30  |  224 b   |  10 lines  |  [TEXT/R*ch]
  1. # robots.txt file
  2. # 
  3. # purpose to World Wide Web Robots trawling your web site (or parts thereof)
  4. # 
  5. # For more info consult:
  6. #   http://info.webcrawler.com/mak/projects/robots/norobots.html
  7.  
  8. User-agent: *
  9. Disallow: /local/
  10.